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(54) Autostereoscopic display and method of controlling an autostereoscopic display 



(57) An observer tracking autostereoscopic display 
is provided in which the image data displayed by at least 
three image displays (23,40,51,55,58,76,80.135) along 
respective different directions is updated depending on 



the lateral position of an observer. The image displayed 
in a viewing region not visible to the observer is updated 
with an appropriate image in anticipation of the observer 
moving to a position where that viewing region is visible. 
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Description 

The present invention relates to an autostereoscop- 
ic display, and to a method of controlling an autostere- 
oscopic display. 

It is desirable to provide an autostereoscopic dis- 
play in which the three dimensional effect is perceived 
for a wide range of observer positions. 

Methods of producing autostereoscopic images re- 
ly on presenting different views to the left and right eyes 
of an observer. This can be achieved by dividing the 
views for the left and right eyes into a series of inter- 
leaved vertical stripes. Alenticularscreen is then placed 
adjacent the composite image such that each lenticule 
covers one view slice of the left eye image and one view 
slice of the right eye image. 

Electrically controlled displays may also split the left 
and right eye images into vertical stripes and replay the 
images along different directions using a lenticular 
screen. In another arrangement, two screens may dis- 
play the images for the left and right eyes, respectively, 
and the images therefrom can be combined by a beam 
combiner. Such a display is disclosed in EP-A-0602934. 
A single spatial light modulator can also be driven in a 
time multiplexed manner to reproduce the left and right 
eye images, the position of a source of illumination being 
varied in a time multiplexed manner so as to project the 
different images in different directions. The displays re- 
quire the viewer to be positioned in a defined viewing 
region to observe the 3D effect. 

K. Akiyamaand N. Tetsutani, "3-Dimensional Visual 
Communication", ITEC'91: 1991 ITE Annual Conven- 
tion, disclose an observer tracking autostereoscopic 
display in which a liquid crystal display device is posi- 
tioned in close proximity to a lenticular sheet such that 
each lenticule is in front of two columns of pixels of the 
LCD display. Such an arrangement angularly multiplex- 
es the light emitted from the columns of pixels in the 
display. The display is driven so as to provide interlaced 
left and right images for projection to the left and right 
eyes of an observer. Movement of the observer makes 
it possible for the observer's left eye to be in a position 
where it receives the image intended for the observer's 
right eye and vice versa. A position detector monitors 
the position of the observer's head and is arranged to 
swap the left and right images over in response to move- 
ment of the observer such that the correct image is pre- 
sented to the correct eye. 

Such a system will allow limited freedom of move- 
ment of an observer laterally with respect to the display. 

EP-A-0 354 851 discloses both a "two window" and 
a "four window" display. As shown in Figure 1 of the ac- 
companying drawings, the constituent parts of the auto- 
stereoscopic image in a two window display converge 
at viewpoint corrected zones. Image data for a first two 
dimensional (2D) image originating from a first end of 
the display 5 is constrained to lie in a zone 6, whereas 
image data for the same 2D image originating from an 



opposite side of the display is constrained within a zone 
8. The zones 6 and 8 overlap to provide a first viewpoint 
corrected zone 12. Similarly, image data for a second 
2D image is constrained to lie in zones 7 and 10 and 

5 these zones overlap to provide a second viewpoint cor- 
rected zone 1 4. The observer can perceive an autoster- 
eoscopic image when one of the observer's eyes is in 
the first viewpoint corrected zone 1 2 and the other of the 
observer's eyes is in the second viewpoint corrected 

10 zone 14. If the observer's eyes are not within the view- 
point corrected zones, the observer does not see a 3D 
image over the whole of the display. 

The "four window" display is an extension of the two 
window display and operates on the same principle. In 

15 each case the view point corrected zones have a dis- 
torted "diamond" shape. The maximum widths of the 
view point corrected zones occur at a nominal viewing 
distance from the display. It is convenient to describe 
the maximum width of the viewpoint corrected zone as 

20 being a "window". 

The "four window" display disclosed in EP-A-0 354 
851 has a lenticular screen disposed adjacent a display 
device. Each lenticule is associated with a respective 
set of four columns of pixels. Considering just a single 

25 row of pixels for simplicity, two of the pixels R-, and R 2 
display image data for presentation to the observer's 
right eye whereas the other two pixels L, and L 2 display 
image data for presentation to the observer's left eye. 
The pixels , R 2 , L-| and L 2 can be arranged in any one 

30 of four combinations, these are: R., -Rg-I^ -L 2 , L^Lg-R.,- 
R 2 , L2-R1-R2-L1 and R 2 -L 1 -L 2 -R 1 . Thus the images pre- 
sented to each window are swapped simultaneously, in 
order to provide observer tracking with no moving pacts. 
The prior art systems place exceptionally high de- 

35 mands on the accuracy of the tracking equipment. The 
views must be changed exactly when each of the ob- 
server's eyes passes from one window to an adjacent 
window. 

It is desirable to provide a "look around" display in 

40 which the view presented to the observer is a function 
of the observer's position. It has been estimated that six- 
ty views per interocular separation may be required in 
order to achieve an artifact free representation of a 3D 
image. A 500 line lenticular display having a width of 

45 250 mm implies that the size of each lenticule will be 0.5 
mm. Sixty interocular views would imply a maximum pix- 
el size of 8 micrometers. Such a fine pixel pitch is not 
presently available over such a large distance. Provid- 
ing such a number of views by means of a beam com- 

50 biner-type display would require sixty spatial light mod- 
ulators. Embodying such a display as a temporally mul- 
tiplexed display would require aframe refresh rate of the 
order of 3 kHz. 

The number of simultaneously presented views re- 

55 quired to provide a "lookaround" 3D image can begreat- 
ly reduced by using an observer tracking display, since 
only the views directed towards the observer's eyes 
need be displayed. An arrangement in which the posi- 
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tions of the "windows" are movable so as to move with 
movement of an observer is disclosed in EP 0 576 106 
and EP 0 656 555. EP 0 576 1 06 also discloses the con- 
cept of providing a "look around" facility. 

According to a first aspect of the invention, there is 5 
provided a display as defined in the appended Claim 1 . 

According to a second aspect of the invention, there 
is provided a method as defined in the appended Claim 
15. 

According to a third aspect of the invention, there is 10 
provided a display as defined in the appended Claim 1 6. 

Preferred embodiments of the invention are defined 
in the other appended claims. 

It is thus possible to provide a display in which the 
observer has a greatly enhanced freedom of lateral ?5 
movement, sensitivity to tracking errors is reduced and 
a "look around" facility may be provided. 

The views may be views of a moving scene. Each 
of the views may be updated to show movement within 
the individual views. Thus the term "updating" as used 20 
herein more specifically relates to swapping the images 
representing different stereoscopic viewing directions. 

Thus, the requirement for accuracy of the tracking 
system can be reduced since the window towards which 
an eye is moving and is about to enter can be updated 25 
to display the same view information as the window that 
the eye is currently in and is about to leave. Thus the 
necessity for accurate positional information to achieve 
image switching can be eliminated. 

The present invention will further be described, by 30 
way of example, with reference to the accompanying 
drawings, in which:- 

Figure 1 is a diagram schematically illustrating the 
positions of view point corrected zones for a two 35 
window display; 

Figure 2 is a schematic illustration of the output of 
a multi-lobe two window display and the image 
swapping requirements thereof; 40 

Figure 3 schematically shows the generation of a 
three view, three lobe display by a single spatial light 
modulator and a lenticular array; 

45 

Figure 4 is a schematic illustration of the output of 
a multi-lobe three window display constituting an 
embodiment of the present invention and the image 
switching requirements thereof; 

50 

Figure 5 is a schematic illustration of the output of 
a multi-lobe four window display constituting an em- 
bodiment of the present invention and the image 
switching requirements thereof; 

55 

Figures 6a and 6b schematically illustrate the range 
of positions with respect to the display in which an 
observer will perceive the autostereoscopic effect: 



Figure 7 is a schematic illustration of a time multi- 
plexed display constituting an embodiment of the 
present invention; 

Figure 8 is a schematic illustration of a three view 
beam combiner display constituting an embodiment 
of the present invention: 

Figure 9 is a schematic diagram of a time multi- 
plexed display with compact illumination constitut- 
ing an embodiment of the present invention; 

Figure 1 0 is a schematic diagram illustrating a four 
view display constituting a further embodiment of 
the present invention; 

Figure 1 1 schematically illustrates the tracking and 
image controller for a display constituting an em- 
bodiment of the present invention; 

Figure 12 schematically illustrates a pixel arrange- 
ment within an LCD screen for allowing the forma- 
tion of contiguous image zones in lenticular dis- 
plays; 

Figure 13 is a schematic illustration of another three 
view beam combiner display constituting an embod- 
iment of the invention; 

Figure 1 4 is a schematic sectional view of part of a 
display using a front parallax barrier; 

Figure 1 5 is a schematic sectional view of part of a 
display using a rear parallax barrier; 

Figures 16 and 17 illustrate diagrammatically the 
use of holograms to form viewing windows; 

Figure 1 8 is a schematic sectional view of part of a 
display using an internal hologram; 

Figure 1 9 is a schematic sectional view of part of a 
display using an external hologram; 

Figures 20 and 21 are schematic sectional views of 
compact backlight for illuminating holograms; 

Figure 22 is a schematic illustration of the output of 
a multi-lobe three window display constituting an 
embodiment of the present invention and the image 
switching requirements thereof; 

Figure 23 is a graph of image intensity against eye 
position for the display illustrated in Figure 22; 

Figure 24 illustrates use of a display of the type 
shown in Figure 22 with manual control of observer 
position for a computer game; and 
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Figures 25 to 27 illustrate images produced by the 
display of Figure 24 and visible to an observer in 
different positions. 

As shown in Figure 1, an autostereoscopic display 
emits (in plan view) cones of light along predetermined 
directions. Each cone of light represents part of a view 
from a given viewing position. Cones relating to the 
same view, but emanating from different parts of the dis- 
play can be arranged to converge at a view point cor- 
rected zone by, for example, making the pitch of a len- 
ticular screen within the display slightly less than the 
pitch of pixel groups within the display. The distance be- 
tween the display 5 and the widest portions of the view- 
point corrected zones 12 and 14 corresponds to a de- 
sign viewing distance for the display. The positions of 
the viewpoint corrected zones for the display of Figure 
1 are fixed in space with respect to the display and 
hence such a display has a limited viewing area where 
the three dimensional effect can be perceived. Lateral 
movement of an observer will result in loss of the ster- 
eoscopic image if either of the observer's eyes moves 
outside a viewpoint corrected zone or if both eyes move 
into the same viewpoint corrected zone. 

The display may be arranged to form a repeating 
pattern of viewpoint corrected zones. The zones can be 
positioned such that they define a repeating pattern of 
contiguous "windows", as shown in Figure 2 for a two 
window display. The "windows" are defined by the wid- 
est regions of the view point corrected zones. 

The display 2 produces an output which is a repeat- 
ing pattern of first and second viewing windows labelled 
W1 and W2, respectively. Each of the positions A to E 
in Figure 2 represents only the lateral position of the ob- 
server. The longitudinal position of the observer is coin- 
cident with the windows. With the observer at position 
"A", the observer's left eye observes the image present- 
ed in window W1 , whereas the observer's right eye ob- 
serves the image presented in window W2. If the ob- 
server moves to position "C", then the image data shown 
in windows W1 and W2 must be swapped in order to 
maintain the autostereoscopic view. Furthermore, 
movement between positions A and C will result in the 
observer's eyes moving through position B. Position B 
represents a boundary position where the images pre- 
sented to the observer's eyes must be swapped. The 
images viewed by each eye must be swapped at the 
same time such that both eyes do not receive the same 
view. Otherwise the autostereoscopic effect will be lost. 

As noted hereinabove, the positions at which the 
images presented to each eye must be swapped in or- 
der to maintain a true 3D effect must be accurately de- 
termined. 

The problems of the prior art displays can be over- 
come by using a display which has a display output hav- 
ing at least three windows in conjunction with an image 
controller which can control the image presented to 
each window independently. The display advanta- 



geously forms a repeating pattern of the windows to al- 
low a greater range of lateral movement of the observer. 

Figure 3 schematically illustrates in plan view the 
generation of three views imaged into three lobes using 

5 a lenticular array 22 and a spatial light modulator 23. 
The spatial light modulator 23 is arranged to display 
three images simultaneously in a spatially multiplexed 
fashion - and hence acts as three different displays. The 
first display is composed of pixels A, the second display 

10 is composed of pixels B, and the third display is com- 
posed of pixels C. The displays are interleaved so as to 
form a repeating pixel pattern ABC ABC etc. The lenticu- 
lar array 22 comprises a plurality of lenticules whose in- 
dividual widths are substantially the same as the spatial 

15 extent of the three pixels ABC. Furthermore the centre 
of each lenticule is substantially aligned with its respec- 
tive B pixel (this condition changes slightly for view point 
corrected displays where the pitch of the lenticules is 
slightly less than the pattern repeat pitch ABC - but those 

20 lenticules towards the centre of the display are substan- 
tially aligned with the respective B pixels). The images 
from the pixels are imaged through the lenticules - as 
shown - to provide three lobes, labelled -1, 0 and + 1, 
each of which comprises three images A', B' and C. As 

25 described hereinabove with reference to Figure 1 , view 
point correction results in the separate images combin- 
ing within respective image regions, labelled 1 , 2 and 3 
in Figure 4. 

Figure 4 schematically illustrates an autostereo- 

30 scopic display comprising the lenticular display illustrat- 
ed in Figure 3. As before, image data are presented to 
the display device 23 so as to generate a number of out- 
put cones, each of which corresponds to a different view. 
Cones corresponding to the same view converge at a 

35 designed position so as to form a viewpoint corrected 
zone at which the observer can observe the autostere- 
oscopic effect. The widest part of each viewpoint cor- 
rected zone defines a "window". The "window" occurs 
at a predetermined distance from the display device. 

40 The windows are contiguous with one another and 
hence define a laterally extended viewing region at 
which the autostereoscopic effect can be observed pro- 
vided that the image displayed in each window is updat- 
ed in accordance with the observer's position. 

45 The three windows are labelled 1 , 2 and 3 and are 
imaged intothree lobes labelled -1 , 0 and + 1 . Generally, 
the size of each window is determined by 2e/N, where 
e is the average interocular separation of a particular 
user group (e.g. approximately 65mm for the adult pop- 

50 ulation, less for younger user groups) and N is the 
number of windows in each lobe. Thus, for the "three 
window" display, each window has a lateral extent of 
two-thirds of the average interocular separation of an 
adult. The display is arranged such that each window 

55 displays either left view data or right view data. The left 
and right views are not mixed within a window. 

With an observer at position A of Figure 4, the ob- 
server's right eye R is within the first window 1 of the 
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zeroth lobe and the observer's left eye is at the boundary 
of the second and third windows 2 and 3 of the zeroth 
lobe. The positions A to G show the lateral position of 
the observer, but the longitudinal position is always at 
the nominal viewing distance. In order to provide an 
autostereoscopic view, the first windows 1 are controlled 
(via the first display) to show right view data and the sec- 
ond and third windows are controlled (via the second 
and third displays) to show left view data. As the observ- 
er moves from position A to position B, the observer's 
right eye moves towards the boundary between the first 
and second windows of the zeroth lobe. Similarly the 
observer's left eye moves away from the boundary be- 
tween the second and third windows of the zeroth lobe. 
The result is that the second window 2 becomes unob- 
served and the image data displayed thereby can be up- 
dated from left view data to right view data in anticipation 
of the observer arriving at position B. Once the observer 
is at position B, the observer's right eye is at the bound- 
ary between the first and second windows 1 and 2 of the 
zeroth lobe - both of which show right viewdata - where- 
as the observer's left eye is at the centre of the third 
window which shows left view data. 

As the observer moves from position B to position 
C, the first window 1 of the + 1 lobe is updated to show 
left view data in anticipation of the observer's left eye 
being at a position where the first window of the + 1 lobe 
can be observed. 

In such a display, all the first windows of all the lobes 
show the same image and are updated simultaneously. 
Thus, the first windows of the -1 and zeroth lobes are 
also updated, but this is of no consequence as the ob- 
server moving between positions B and C cannot see 
these windows. 

The same sequence of events is repeated for move- 
ment between each of the positions, that is, the image 
displayed by a window is updated while the observer is 
not able to see that window. 

Figure 5 is similar to Figure 4, but shows the situa- 
tion for a display having four windows 1 to 4, each win- 
dow having a lateral width of half the average interocular 
separation of the particular user group. It should be not- 
ed that, for example, at a position intermediate the po- 
sitions A and B of Figure 5, the observer's right eye ob- 
serves only the first window 1 of the zeroth lobe, where- 
as the observer's left eye observes only the third window 
3 of the zeroth lobe. As before, the unobserved windows 
are updated in anticipation of the observer moving to a 
position where they become observed. 

The smaller window width allows a greater number 
of views to be displayed for a given lateral displacement 
of the observer. This is beneficial if the image data are 
also updated to give a "look around" effect. 

Figures 6a and 6b compare the spatial extent of the 
viewing regions at which the autostereoscopic effect 
can be observed. In each figure the position Z repre- 
sents the nominal window position of a display not in- 
corporating an embodiment of the present invention. 



Figure 6a indicates the viewing position for a multi-lobe 
display not having observer tracking. Figure 6b shows 
the observer positions for a multi-lobe display incorpo- 
rating lateral observer tracking. In each case, the ordi- 
5 nate represents the axis of display symmetry (i.e. mid- 
line of the display) and the shaded regions represent the 
area in which the autostereoscopic effect can be per- 
ceived. 

The provision of lateral tracking also allows a mod- 
10 est increase in longitudinal freedom of position of the 
observer. 

Embodiments of the present invention make it pos- 
sible to produce a large field for autostereoscopic view- 
ing. The image content displayed to the observer may 

15 also be made to vary with respect to observer position 
so as to give a "look around" (i.e. views containing par- 
allax information) view to the observer. 

Methods of tracking the observer's position may in- 
clude magnetic, infrared, ultrasonic and video tracking. 

20 Tracking systems are known per se and need not be 
described here in detail. 

Figure 7 schematically illustrates an embodiment of 
the present invention. The display comprises a spatial 
light modulator 40, a lens 47 and an illumination source 

25 41 comprising six light emitting elements arranged in 
pairs 42, 43, and 44. The lens 47 acts to form an image 
of the source 41 at the nominal viewing distance Z. Each 
pair of light emitting elements has the same inter-ele- 
ment distance as each other pair and the elements are 

30 arranged in a common plane. The pairs of light emitting 
elements are illuminated in sequence. Video informa- 
tion is supplied to the spatial light modulator in a time 
multiplexed manner in sequence with the successive il- 
lumination of each pair of illuminators. Such a display 

35 provides two lobes 45 and 46 each having three win- 
dows at the nominal viewing position Z. If the six light 
emitting elements are individually controllable, the dis- 
play may be operated as a six window single lobe dis- 
play to achieve the same freedom of movement. 

40 Figure 8 illustrates a further embodiment of the in- 
vention. A first light source 50 comprises three regularly 
spaced illuminators and is arranged to illuminate a first 
spatial light modulator 51 via a lens 52. Similarly, a sec- 
ond light source 54 comprises three regularly spaced 

45 illuminators and is arranged to illuminate a second spa- 
tial light modulator 55 via a lens 56. A similar arrange- 
ment is provided in respect of a third light source 57, a 
third lens 59 and athird spatial light modulator 58. Afirst 
beam combiner 60 combines the images of the first and 

50 second light sources 50 and 54, respectively, following 
modulation by their respective spatial light modulators. 
This combined image is further combined at a second 
beam combiner 62 with the image of the third light 
source 57 following modulation by the third spatial light 

55 modulator 58. The images are arranged to be laterally 
offset with respect to one another so as to provide an 
output of three lobes (labelled -1 , 0 and + 1 ) each com- 
prising three windows. The windows form a substantially 



5 



9 



EP 0 726 482 A2 



10 



contiguous output at a nominal viewing position Z. 

Figure 9 schematically illustrates a further embodi- 
ment of the present invention. A back light 70 comprises 
three groups of light emitting elements. Elements be- 
longing to the first group are labelled 71 , elements be- 
longing to the second group are labelled 72 and ele- 
ments belonging to the third group are labelled 73. The 
light emitting elements are arranged in a repeating se- 
quence of an element from the first group, an element 
from the second group and an element from the third 
group. Light from the light emitting elements is collected 
by an array of lenses 75 and is directed towards a nom- 
inal observer viewing position Z via a spatial light mod- 
ulator 76. Each group of light emitting elements is illu- 
minated in turn and the spatial light modulator is driven 
in a time multiplexed manner so as to present a different 
view to each one of the viewing windows. 

Figure 10 schematically illustrates a display consti- 
tuting an embodiment of the present invention. A spatial 
light modulator 80 is sandwiched between first and sec- 
ond lenticular arrays 82 and 84. The first array 82 is ad- 
jacent the spatial light modulator 80 and has a pitch sub- 
stantially equal to that of the spatial light modulator. The 
second lenticular array 84 has a pitch substantially twice 
that of the first lenticular array. Adiffuser86 is positioned 
intermediate the spatial light modulator 80 and the sec- 
ond lenticular screen 84. First and second light sources 
88 and 90 are arranged to illuminate the first lenticular 
array 82 via a lens 92. The diffuser 86 is positioned such 
that an image of the light sources 88 and 90 is formed 
thereon following modulation by the spatial light modu- 
lator 80. The diffuser 86 also lies in an object plane of 
the second lenticular screen 84. The second lenticular 
screen 84 re-images the diffuser 86 at the nominal view- 
ing position Z. 

The light sources 88 and 90 and the spatial light 
modulator 80 are driven in a time multiplexed manner. 
When the first light source 88 is illuminated; a first mod- 
ulating element 94 of the spatial light modulator 80 forms 
a modulated image at a position 95 on the diffuser 86 
whereas a second element 96 of the spatial light mod- 
ulator 80 forms an image at a position 97 on the diffuser 
86. These positions are re-imaged as elements of win- 
dow views 1 and 4 of each lobe. When the first illumina- 
tor 88 is extinguished and the second illuminator 90 is 
illuminated, the same modulating elements 94 and 96 
form images at positions 98 and 99 respectively on the 
diffuser 86. These images form elements of windows 2 
and 3 in each lobe. Such an embodiment combines both 
spatial and temporal multiplexing to provide a multi-lobe 
four view display. 

Figure 11 schematically illustrates a video multi- 
plexing system for controlling the views displayed by the 
displays. Although three or four windows are provided, 
only left and right eye view information is required. Left 
eye view information is provided via a buffer 100 to left 
view inputs of first, second and third video switches 1 02, 
104 and 106. Similarly right eye view information is pro- 



vided via a buffer 1 08 to right eye inputs of the first, sec- 
ond and third video switches. Each video switch is re- 
sponsible for selecting the video view to be provided to 
one of the display devices for display at one of the win- 

5 dows. Each video switch may control a respective dis- 
play device or may be arranged to drive a single display 
in a multiplexed fashion, for example as shown in Figure 
7. Each video switch receives a control input from a con- 
troller 110 which selects whether the left view or right 

10 view should be displayed. The controller 110 is respon- 
sive to a tracking system 112 which determines the po- 
sition of an observer. From a knowledge of the observ- 
er's position and the parameters of the display, the con- 
troller selects appropriate views and instructs the video 

15 switches to display the relevant left or right views. The 
switch points used by the controller 110 are determined 
generally by a calibration of the system, for instance by 
an observer moving to a defined optical position such 
as a window boundary and a measurement of the ob- 

20 server position being made. Alternatively, the controller 
110 may be responsive to a manual control 111 which 
is manually operated by an observer as described here- 
inafter. 

For a display using a lenticular screen, such as the 

25 display illustrated in Figure 3, it is desirable that masked 
areas of the spatial light modulator should not be imaged 
as black bands which move as the observer moves. The 
arrangement of pixels as shown in Figure 12 enables 
lateral gaps between the pixel group 120 and the pixel 

30 group 1 22 to be eliminated while still providing space for 
control lines within the display. 

The display shown in Figure 13 differs from that 
shown in Figure 8 in that the light sources 50, 54, and 
57 and the lenses 52, 56, and 59 are replaced by com- 

35 pact illuminators 50a, 54a, and 57a. The compact illu- 
minator 50a comprises a lenticular screen 50b behind 
which is disposed a parallax barrier 50c. The parallax 
barrier 50c comprises a plurality of slits, each of which 
is aligned with a lenticule of the lenticular screen 50b. A 

40 Lambertian backlight 50d is disposed behind the paral- 
lax barrier 50c. The compact illuminators 54a and 57a 
are identical to the compact illuminator 50a. 

Each lenticule of the lenticular screen 50b images 
the aligned slit of the parallax barrier 50c to the window 

45 of the zero lobe. In addition, the adjacent lenticules im- 
age the same slit to the same windows in the -1 and + 
1 lobes of the viewing windows. Accordingly, the display 
shown in Figure 13 operates in the same way as that 
shown in Figure 8 but can be made more compact. 

50 Figure 1 4 shows part of a display which differs from 
that shown in Figure 3 in that the lenticular screen 22 is 
replaced by a parallax barrier 22a. The barrier 22a com- 
prises a plurality of slits aligned with the pixels of the 
liquid crystal display 23 as shown in Figure 14. A Lam- 

55 bertian backlight 50d is provided behind the liquid crys- 
tal display, whose pixels are contiguous with each other. 

As shown in Figure 14, each slit directs light along 
light cones to the first, second, and third windows of the 
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zero lobe from the associated pixels. Further, the slits 
form + 1 and -1 lobe windows such that the windows in 
each lobe are contiguous with each other and the lobes 
are contiguous with each other. 

Although displays of the type shown in Figure 14 
having a "front" parallax barrier 22a produce a darker 
image, for a given level of illumination, compared with 
displays using lenticular screens, parallax barriers do 
not suffer from the optical aberrations of lenticular 
screens. In a front parallax barrier display, the quality of 
the windows, particularly in terms of the width of the 
boundary of each window, produced at the plane of an 
observer is controlled by the width of the slits. If the slits 
are made narrower, the geometric spreading of each 
window edge is reduced. However, the amount of dif- 
fraction occurring at the slit increases with decreasing 
width of each slit so that it is necessary to choose the 
width of the slits as a compromise between diffraction 
and geometric degradation effects. 

Figure 15 illustrates part of a display which differs 
from that shown in Figure 14 in that the front parallax 
barrier 22a is replaced by a rear parallax barrier 22b dis- 
posed between the liquid crystal display 23 and the 
backlight 50d. A switchable diffuser 1 30 is provided be- 
tween the barrier 22b and the display 23. The surface 
of the barrier 22b facing the backlight 50d is made re- 
flective so that light which does not pass through the 
slits of the barrier 22b is reflected back to the backlight 
50d for reuse. This improves the brightness of the dis- 
played image. 

The use of a rear parallax barrier 22b results in the 
geometric spreading of each window edge being con- 
trolled by the width of the slits of the parallax barrier 
whereas the diffraction spreading of the edges is con- 
trolled by the width of the pixels of the display 23. It is 
therefore possible to improve the quality of the window 
imaging compared with the display shown in Figure 14 
using the front parallax barrier. 

The display may be used for two dimensional (2D) 
operation by switching the switchable diffuser 1 30 so as 
to diffuse light from the slits of the barrier 22b. The liquid 
crystal display 23 is then illuminated by a Lambertian 
source and 2D images are visible throughout a wide 
viewing range. 

The rear parallax barrier 22b may be made as an 
array of transparent slits in an opaque mask. Alterna- 
tively, the barrier may be made by imaging a defined 
size light source through a lenticular screen on to a dif- 
fuser. 

Figure 1 6 illustrates diagrammatically an alternative 
technique for producing three or more contiguous win- 
dows by means of a hologram 1 31 comprising a plurality 
of holographic elements 1 32 associated with respective 
pixels of the spatial light modulator of the display and 
tuned for the appropriate colour filters of the pixels. Such 
holographic elements 1 32 are equivalent in operation to 
a lenticular screen or parallax barrier and, when appro- 
priately illuminated for instance by a collimated white 



light reconstructing beam 133, each holographic ele- 
ment 1 32 produces a defined window for the associated 
colour. Each holographic element may be recorded so 
as to define several lobes as shown in Figure 16. The 

5 holographic elements 132 are arranged in groups so 
that the light from each group of pixels is imaged to one 
of the three or more groups of windows as shown in Fig- 
ure 17. The intensity of the light is controlled by the pixel 
switching properties and the directionality by the holo- 

10 gram 1 31 . An advantage of using holograms is that they 
are capable of providing significant improvements to the 
off-axis behaviour of the display because off-axis aber- 
rations can be substantially cancelled when recording 
the holograms. 

15 As shown in Figure 18, the hologram 131 may be 
disposed inside a spatial light modulator 135 together 
with a liquid crystal layer 136 and a colour filter 137. 
Thus, the hologram is disposed substantially at the 
plane of the liquid crystal device forming the SLM 135, 

20 for instance by controlling the pattern of a black mask 
inside the pixel aperture. The hologram at each pixel can 
be tuned so as to direct light for the particular colour 
associated with the colour filter for that pixel to the ap- 
propriate window. This is indicated in Figure 18 by ab- 

25 breviations such that "W" refers to a window and "R", 
"G", and "B" refer to red, green, and blue light, respec- 
tively. Thus, the while light performance of the display 
may be improved. For instance, a light source for the 
display may contain three narrow spectral peaks which 

30 may be obtained by the appropriate choice of phosphors 
used in fluorescent tubes which, in combination with the 
colour filter and pixels, results in relatively small spectral 
spreading of the light from the holographic elements. 
Figure 19 shows an alternative arrangement in 

35 which the hologram 131 is disposed on the outer surface 
of the SLM 135. In this arrangement, by using collimated 
illumination, it is possible to make use of holograms 
formed in a photopolymer or dichromated gelatine or in 
the form of etched surface relief or embossed holo- 

40 grams. Alternatively by controlling the structure of elec- 
trodes within each pixel of the SLM135, gratings may 
be created in the SLM. 

The holograms 131 may be computer generated or 
may be recorded by interfering light from an illuminated 

45 window with a reference beam. For instance, a mask 
may be used to expose a recording plate at the first win- 
dow of each lobe through a red colour filter together with 
a red reference beam. This may then be repeated for 
green and blue light. The process then may be repeated 

50 for each window and each corresponding holographic 
element. 

Figure 20 illustrates a compact collimated white 
backlight which may be used for illuminating the holo- 
grams 131. The backlight shown in Figure 20 differs 
55 from that shown in Figure 1 3 in that barriers 50e are ar- 
ranged between elements of the lens array 50b and the 
lens array 50b is arranged to produce collimated light. 
The rear surface of the barrier 50c is made reflective so 
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as to return unused light to the backlight illuminator 50d 
for reuse. 

Figure 21 shows a collimated backlight which differs 
from that shown in Figure 20 in that the lens array 50b 
and the barrier 50e are replaced by small glass spheres 
1 40 having a large packing density. As another alterna- 
tive ; it is possible to produce collimated light by means 
of an edge lit hologram. 

It is thus possible to provide an observer tracking 
autostereoscopic display having no moving parts. Such 
a display is more robust and offers quicker response 
compared to a display incorporating moving parts. 

Such a display is also relatively insensitive to errors 
in the tracking of the observer. 

The functions of a non-mechanical, electronic, lat- 
eral tracking method and a mechanical tracking method 
(for example, translating a parallax element, for exam- 
ple a parallax barrier or a lenticular screen with respect 
to an SLM or rotating a sandwich comprising at least a 
parallax element and an SLM in a flat panel type display) 
can be combined. It is thus possible to obtain good ab- 
errational performance from the mechanical tracking 
method (the images of an observer's eye through the 
parallax element at the plane of the SLM are kept at or 
near the centre of the SLM pixels) as well as speed and 
extended viewing freedom from the non-mechanical 
tracking method. In this way, as an observer moves to 
a new position, a relatively slow mechanical system can 
either translate the parallax barrier or lenticular screen 
with respect to the SLM ; or rotate the sandwich. Further, 
the non-mechanical tracking method working in con- 
junction with the mechanical tracking method allows the 
observer to maintain an autostereoscopic image 
throughout with extended viewing freedom which is not 
possible if only the mechanical method is used. 

For a three window display, each lenticule 124 has 
a pitch substantially equal to that of three columns of 
pixels. 

The display illustrated in Figure 22 differs from that 
illustrated in Figure 4 in that the sizes of the viewing win- 
dows are substantially equal to the average interocular 
separation. Further, the display is shown providing a 
look around facility comprising nine different views V1 
to V9. This is an example of one possible configuration. 
The principle can also be applied to displays with more 
than three windows per lobe and with more than three 
lobes. The eye positions are illustrated with regard to 
their lateral positions but are actually located in the 
plane of the viewing windows. The lower part of Figure 
22 illustrates which view is being shown in each of the 
windows, an arrow indicating that, for the corresponding 
eye positions shown vertically thereabove ; the view is 
being changed and is not visible to either eye. 

With the eyes in the position illustrated at A, the win- 
dows 2 and 3 contain views V2 and V1 , respectively As 
the eyes move towards the position illustrated at B, the 
view V3 is entered in the window W1. There is some 
blurring of the window boundaries resulting from defo- 



cus, scatter and aberrations of a lenticular screen or be- 
cause of the slit width of a parallax barrier so that, as an 
eye of an observer crosses a window boundary, the ob- 
server sees one view fade into the other, as illustrated 
5 in Figure 23. Although there is substantial disparity be- 
tween the adjacent viewing images, a smooth transition 
occurs as the eye moves across the boundary. In some 
circumstances, this has been found to be beneficial. 
Because of the window boundary blurring and be- 
10 cause the width of the windows is substantially equal to 
the average interocular separation, both eyes of the ob- 
server move across adjacent window boundaries sub- 
stantially simultaneously. There is therefore a relatively 
course stepping of the views as the observer moves lat- 
75 erally across the window boundaries. However, the 
views are switched in the windows which are not cur- 
rently visible to the observer in anticipation of the ob- 
server's eyes moving into the relevant window in the 
same way as described with reference to Figure 4. 

An advantage of the display illustrated in Figure 22 
is that it is less affected by optical errors, which can in- 
hibit the performance of a true look-around type of dis- 
play. Accordingly, lower performance and cheaper opti- 
cal elements may be used and reduced accuracy in the 
tracking devices can be tolerated. Further, the use of 
larger windows allows larger viewpoint corrected zones 
to be provided, thus giving the observer greater viewing 
freedom. 

The display shown in Figure 22 is not required to 
generate images as rapidly as for full look-around dis- 
plays. Further, the response speed of the tracking sys- 
tem and an image generation system need not be as 
high as for a full look-around display. 

For some applications, it is not necessary to provide 
a tracking system which automatically detects the posi- 
tion of the observer so as to switch views imperceptibly 
to the observer. For instance, the automatic tracking 
system may be replaced by a hand controller manually 
controlled by the observer so as to perform view switch- 
ing to suit the current position of the observer. This al- 
lows the viewing freedom to be extended without requir- 
ing the complication and expense of an automatic ob- 
server tracking system. It is possible for an observer to 
become accustomed to switching the views in anticipa- 
tion of moving to a new position. Although suitable for 
use with displays providing three windows in each lobe, 
the use of manual tracking with displays providing more 
than three windows per lobe may be beneficial as this 
reduces the number of times the observer has to update 
the display during movement. 

The effect of blurring at the window boundaries may 
be enhanced by manipulation of the images supplied to 
the display. The blurring effect may be used in displays 
with two windows as well as in displays with more than 
three windows. In each case, blurring can serve to 
"wash out" the visibility of any errors in the display. Blur- 
ring may also be introduced by fading the image to mon- 
oscopic or to black at the boundary so that, although the 
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boundary is still visible, any annoying artifacts of this are 
reduced. 

Window boundary blurring may also be advanta- 
geous in displays of lower graphics performance. For 
instance, if the images cannot be updated sufficiently 
quickly, some window boundary blurring between adja- 
cent images during look-around may be provided to re- 
duce "flipping" artifacts in displays. 

In order to avoid unpleasant visual artifacts outside 
the viewing region of the display, the light sources may 
be switched off when the observer is outside the viewing 
region. This may be performed not only for lateral move- 
ment outside the viewing region but also for vertical 
movement, both of which may be subject to the effects 
of aberrations in the optical elements. Instead of switch- 
ing off the light source, it may be made to fade gradually 
as the observer approaches the edge of the viewing 
range. 

In the case of manual switching of windows having 
a view in each window of the lobe, it may be possible 
for an observertoseeapseudoscopic image atthe edge 
of the lobe if the windows are not switched at the appro- 
priate time (e.g. by an inexperienced user). To avoid this 
possibility, it may be desirable to display a grey level 
(such as white) in the third window. The observer cannot 
then be confused during the switching process because, 
at the edge portions, the image will appeartoturn a grey 
colour and then become 2D as one eye sees the grey 
window and the other eye sees the edge view. 

Pressing buttons of the hand controller by the ob- 
server may be used to provide a position signal which 
is fed back to an image generation system. This maybe 
used not only to ensure that the observer sees images 
in both eyes but also such that the images are adjusted 
for the particular viewing direction. For instance, in a 
computer game application, software may be config- 
ured to allow certain parts of the game to be performed 
only when the observer is in a particular position to the 
left of the display. Thus, a unique feature may be added 
to the game software with such a display. 

Figure 24 illustrates the use of a display of the type 
shown in Figure 22 to perform such a function in com- 
bination with software for a computer game. Observer 
positions A, B and C are shown and Figures 25 to 27 
illustrate the images which are visible from these posi- 
tions for an example of a computer game. The observer 
uses the manual control 111 shown in Figure 11 to indi- 
cate his position to software controlling the display, for 
instance controlling a microprocessor forming part of the 
controller 110 of Figure 11 . 

When the observer uses the manual control 111 to 
indicate that he is located at observer position A, data 
representing this position are supplied to the computer 
game software which causes the display to provide ap- 
propriate images to appear in the windows where the 
observer eyes are located. Figure 25 illustrates, purely 
by way of example, that a wall is visible to the observer 
when in the position A. 
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The observer may move to the position B and signal 
this to the controller 110 by means of the manual control 
111. The controller 1 1 0 then causes the display to pro- 
vide images at the windows where the observer is locat- 

5 ed giving a 3D image of the type shown in Figure 26. 
Thus, the observer can see a sword 140 located "be- 
hind" the wall 141. 

If the observer moves to the position C and signals 
this to the controller 110 by means of the manual control 

10 111, the images change such that the observer then 
sees a 3D image of a game character 142 with whom 
the observer can interact by way of the manual control 
111 . For instance, the manual control 111 may have con- 
trol buttons and the like for interfacing with the game 

15 software in addition to indicating the position of the ob- 
server. 



Claims 

20 

1. An observer tracking autostereoscopic display 
comprising: at least three image displays (23, 40, 
51 , 55, 58, 76, 80, 1 35) arranged to direct respec- 
tive images along different directions so as to define 

25 a pattern of at least three image regions at a nom- 
inal viewing distance; and an observer tracker (112) 
for detecting the position of an observer character- 
ised by an image controller (100, 102, 104, 106, 
108, 110) responsive to the observer tracker (112) 

30 for updating the images displayed by the image dis- 
plays (23, 40, 51 , 55, 58, 76, 80, 1 35) such that the 
image displayed in an image region which is not vis- 
ible to an observer is updated in anticipation of an 
observer eye moving into that image region and im- 

35 ages displayed in image regions which are visible 
to the observer are not updated. 

2. An autostereoscopic display as claimed in Claim 1 , 
characterised in that each of the image displays (23, 

40 40, 51, 55, 58, 76, 80, 135) is arranged to repeat 
the respective image regions in a plurality of lobes. 

3. An autostereoscopic display as claimed in Claim 1 
or 2, characterised in that adjacent pairs of the im- 

45 age regions are substantially contiguous. 

4. An autostereoscopic display as claimed in any one 
of the preceding claims, characterised in that the 
image displays are spatially multiplexed within a 

50 single display device (23, 80). 

5. An autostereoscopic display as claimed in Claim 4, 
characterised in that the single display device (23, 
80) is adjacent an array (22, 22a, 22b, 84) of paral- 

55 lax elements and is divided into repeating regions 
of N columns where N is the number of image dis- 
plays, each region of N columns being adjacent a 
respective element or column of elements of the ar- 
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ray (22, 22a, 22b, 84). 

6. An autostereoscopic display as claimed in Claim 5, 
characterised in that the array of parallax elements 
comprises a lenticular screen (22, 84). 

7. An autostereoscopic display as claimed in Claim 5, 
characterised in that the array of parallax elements 
comprises a parallax barrier (22a, 22b). 

8. An autostereoscopic display as claimed in Claim 4, 
characterised by a hologram (131) arranged to di- 
rect the images along the different directions. 

9. An autostereoscopic display as claimed in any one 
of Claims 4 to 8, characterised in that the single dis- 
play device (23, 80) is a spatial light modulator. 

10. An autostereoscopic display as claimed in any one 
of Claim s 4 to 8, characterised in that the single 
display device is an emissive display. 

11 . An autostereoscopic display as claimed in any one 
of Claims 1 to 3, characterised in that the image dis- 
plays are spatial light modulators (51 , 55, 58), each 
of which is illuminated by at least one light source 
(50, 54, 57, 50a ; 54a, 57a) and the images from 
which are combined by beam combiners (60, 62). 

12. An autostereoscopic display as claimed in any one 
of Claims 1 to 3, characterised in that the image dis- 
plays are temporally multiplexed by a single spatial 
light modulator (40) cooperating with at least three 
individually controllable light sources (41-44) oper- 
ated in a sequence. 

13. An autostereoscopic display as claimed in Claim 
12, characterised in that each of the light sources 
(42-44) comprises at least two light emitting re- 
gions. 

14. An autostereoscopic display as claimed in Claim 4, 
characterised in that the single display device is a 
spatial light modulator (180) illuminated by at least 
two individually controllable light sources (88, 90) 
and arranged to operate in a time multiplexed man- 
ner in synchronism with the light sources (88, 90). 

15. An autostereoscopic display as claimed in Claim 
14, characterised in that the spatial light modulator 
(80) is intermediate first and second arrays (82, 84), 
of parallax elements, the first array (82) having a 
pitch substantially equal to a pixel pitch of the spatial 
light modulator (80) and the second array (84) hav- 
ing a pitch substantially equal to an integer multiple 
of the pitch of the first array (82). 

16. An autostereoscopic display as claimed in Claim 



1 5, characterised in that the pitch of the second ar- 
ray (84) is substantially twice the pitch of the first 
array (82). 

5 17. An autostereoscopic display as claimed in any one 
of the preceding claims, characterised in that the 
image within each of the image regions is inhibited 
from being updated when an eye of an observer is 
within a predetermined distance from the bounda- 

10 ries of that image region. 

18. An autostereoscopic display as claimed in any one 
of the preceding claims, characterised by three im- 
age displays (23, 40, 51 , 55, 58, 76, 80, 1 35). 

is 

19. An autostereoscopic display as claimed in any one 
of the preceding claims, characterised in that the 
image displays (23, 40, 51 , 55, 58, 76, 80, 1 35) are 
arranged to produce each image region with a lat- 

20 eral size substantially equal to 2e/N, where e is an 
average interocular separation for a predefined ob- 
server group and N is the number of the image dis- 
plays (23, 40, 51, 55, 58, 76, 80, 135). 

25 20. An autostereoscopic display as claimed in Claim 
19, characterised in that e is substantially equal to 
65 millimetres. 

21. An autostereoscopic display as claimed in any one 
30 of Claims 1 to 18, characterised in that the image 

displays (23, 40, 51, 55, 58, 76, 80, 135) are ar- 
ranged to produce the image regions such that ad- 
jacent pairs of the image regions cross-fade spatial- 
ly into each other. 

35 

22. An autostereoscopic display as claimed in Claim 

21 , characterised in that the image displays (23, 40, 
51 , 55, 58, 76, 80, 1 35) are arranged to produce the 
image regions with a pitch substantially equal to an 

40 average interocular separation for a predefined ob- 
server group. 

23. An autostereoscopic display as claimed in Claim 

22, characterised in that the pitch of the image re- 
45 gions is substantially equal to 65 millimetres. 

24. A method of controlling an autostereoscopic display 
which provides a pattern of images in at least three 
image regions at a nominal viewing distance, the 

50 method comprising updating the image displayed in 
an image region which is not visible to an observer 
in anticipation of an observer eye moving into that 
image region and not updating the images dis- 
played in image regions which are visible to the ob- 

55 server. 

25. An autostereoscopic display comprising at least 
three image displays (23, 40, 51, 55, 58, 76, 80, 



10 



19 



EP 0 726 482 A2 



1 35) arranged to direct respective images along dif- 
ferent directions so as to define a pattern of at least 
three image regions at a nominal viewing distance, 
characterised by a manual control (111) for opera- 
tion by an observer and an image controller (110, 5 
102, 104, 106, 108, 110) responsive to the manual 
control (111) for updating the images displayed by 
the image displays (23, 40 ; 51 , 55, 58, 76, 80, 1 35). 

26. An autostereoscopic display as claimed in any one 10 
of Claims 1 to 23 and 25, characterised in that the 
image controller (1 1 0) is arranged to permit different 
interactions with the display for different observer 
positions. 



27. An autostereoscopic display as claimed in Claim 26 
when dependent on Claim 25, characterised in that 
the manual control (111) is arranged to control the 
different interactions. 

28. An autostereoscopic display as claimed in Claim 26 
or 27, characterised in that the different interactions 
include supplying different images to the different 
observer positions. 
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